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Abstract 

Background: Heterogeneity is usually a major concern in meta-analysis. Although there are some statistical approaches for 
assessing variability across studies, here we present a new approach to heterogeneity using "MetaPlot" that investigate the 
influence of a single study on the overall heterogeneity. 

Methods: MetaPlot is a two-way (x, y) graph, which can be considered as a complementary graphical approach for testing 
heterogeneity. This method shows graphically as well as numerically the results of an influence analysis, in which Higgins' 
I 2 statistic with 95% (Confidence interval) CI are computed omitting one study in each turn and then are plotted against 
reciprocal of standard error (1/SE) or "precision". In this graph, "1/SE" lies on x axis and "I 2 results" lies on y axe. 
Results: Having a first glance at MetaPlot, one can predict to what extent omission of a single study may influence the 
overall heterogeneity. The precision on x-axis enables us to distinguish the size of each trial. The graph describes I 2 statistic 
with 95% CI graphically as well as numerically in one view for prompt comparison. It is possible to implement MetaPlot for 
meta-analysis of different types of outcome data and summary measures. 

Conclusion: This method presents a simple graphical approach to identify an outlier and its effect on overall heterogeneity 
at a glance. We wish to suggest MetaPlot to Stata experts to prepare its module for the software. 
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Introduction 

Meta-analysis is a useful statistical technique for 
combining multiple quantitative data. This me- 
thod is usually used in the context of a system- 
atic review of the literature. However not all sys- 
tematic reviews include meta-analysis to estimate 
an overall summary measure (1). Since the results 
in meta-analysis are combined from different stud- 
ies, which have not followed a common proto- 
col, heterogeneity is usually a major concern in 
meta-analysis (2). Indeed, heterogeneity will always 
exist whether or not we are able to detect it (3). 
Thus, it is crucial to understand the limitations of 
meta-analysis beside its benefits and the impor- 
tance of detecting sources of variability across 
studies (4). We should keep in mind that dealing 
with heterogeneity is not straightforward (2). 
Although there are some statistical approaches 
for assessing variability across studies, we aim 



to present a new approach to heterogeneity us- 
ing MetaPlot that investigate the influence of a 
single study on the overall heterogeneity. 

Material and Methods 

We developed a two-way graph for Stata sta- 
tistical software, which can be considered as a 
complementary graphical approach for testing het- 
erogeneity. We named this graph "MetaPlot". This 
graph consists of a two axes (x, y) with "recip- 
rocal of standard error" (1/SE) or "precision" on 
x axis, "Higgins' I statistic" with its 95% con- 
fidence interval (CI) on y axis. In this approach, 
first, the overall I 2 statistic is computed. Then, 
by omitting one study in each turn, I 2 statistic is 
recomputed to investigate the effect of each 
study on the overall heterogeneity. Thus, there 
are N+l estimates of I 2 statistic. Finally, these 
computed numerical data are plotted on Meta- 
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Plot in order of studies' precision, therefore, by 
having a first glance at the graph; one can pre- 
dict immediately to what extent omission of each 
study may affect the total heterogeneity 

Results 

In this article, we used the same dataset (5) 
used by Higgins et al. (6) and we used Stata 9 
statistical program for calculation of all numeri- 
cal data presented in the graph (Fig. 1). 
The green curve shows I 2 variations across 
studies with 95% CI [vertical red lines]. "Over- 
all" on the extreme right side of the graph indi- 
cates the overall I value without omitting any 
study from the analysis. Precision on x-axis ( blue 
curve) helps to distinguish the size of each trial. 
By glancing at the graph, one can easily investi- 
gate to what extent omission of a single trial may 
affect the overall heterogeneity and which trial 
has the most influence. Indeed, MetaPlot deter- 
mines how much I" would be changed if a spe- 
cific trial is omitted from the analysis. We can 
also identify easily the "outliers" and their effects 
on the variability across studies. 
In this example, the overall I estimate without 
omission of any study from the analysis is 69% 
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25% 



with 95% CI: 26%, 87%. In this meta-analysis, 
"Wertheimer" study acts as an outlier. If this 
study is omitted from the analysis, the I statis- 
tics would decrease to 31% with 95% CI: 0%, 
73% which indicates non-significant heterogeneity 
between studies. 

Discussion 

This method is a simple way to identify an out- 
lier and its effect on overall heterogeneity. It is 
possible to implement this graph for meta-analysis 
of different types of outcome data (e.g. binary, 
continuous or time to event) and different types of 
summary measures (e.g. odds ratio, risk ratio, 
rate ratio or hazard ratio). 

In conclusion, MetaPlot is a visual complemen- 
tary approach for testing heterogeneity which in- 
vestigates the influence of a single study on overall 
heterogeneity. This method shows graphically as 
well as numerically the results of an influence 
analysis, in which I statistic with 95% CI is com- 
puted omitting one study in each turn. It is possible 
to implement this graph for meta-analysis of 
different types of outcome data as well as summary 
measures. We wish to suggest this method to Stata 
experts to prepare its module for the software. 
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Fig. 1: Meta- Analyses of Residential Exposure to Electromagnetic Fields and Childhood Leukemia 1 , MetaPlot delineates 

I 2 and Q statistics against precision 
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